Dec 14
24
A Google Webmaster Help thread has one webmaster asking why GoogleBot seems to be maxed out at crawling his site at 10 requests per second. The webmaster even documented the behavior over time and plotted it in this graph below…
Read more:
Google Doesn’t Put GoogleBot On A Leash – Manually That Is